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ABSTRACT 


New results are given on the relationships between closed loop 
eigenstructures , state feedback gain matrices of the linear state feed- 
back problem, and quadratic weights of the linear quadratic regulator. 
Previous results are presented and gaps in current Itnowledge are pointed 
out. Equations are derived for the angles of general multivariable 
root loci and linear quadratic optimal root loci, including angles of 
departure cuid approach. The generalized eigenvalue problem is used 
for the first time to compute angles of approach. Equations are also 
derived to find the sensitivity of closed loop eigenvalues and the 
directional derivatives of closed loop eigenvectors (with respect to a- 
scalar multiplying the feedback gain matrix or the quadratic control 
weight) . 

An equivalence class of c[uadratic weights that produce the same 
asymptotic eigenstructure is defined, sufficient conditions to be in 
it are given, a canonical element is defined, and an algorithm to find 
it is given. The behavior of the optimal root locus in the nonasymp- 
totic region is shown to be different for quadratic weights with the 
same asymptotic properties. 

An algorithm is presented that can be used to select a feedback 
gain matrix for the linear state feedback problem which produces a 
specified asymptotic eigenstructure. Another algorithm is given to 
compute tlie asymptotic eigenstructure properties inherent in a given 
set of quadratic weights. This is inherently a structurally unstable 
problem, unless the system is "generic". Finally, it is shown that 
optimal root loci for nongeneric problems can be approximated by gen- 
eric ones in the nonasymptotic region. 
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CHAPTER I 


Introduction 

1.1 Motivation and Summary of Results 

The linear state feedback problem [1] is an important tool used 
for control system design. While any practical design must take many 
factors into consideration, a very common design objective is to 
achieve a specified closed loop eigenstructure . By "eigenstructure" 
we mean both the eigenvalues and the eigenvectors of the closed loop 
system. Hence, an important relationship in design is between the I 

state feedback gain matrix and the resulting closed loop eigenstructure. 

A ve:"!zxon of the linear state feedback problem that has recently 
emerged as an important design is the linear quadratic regulator [2] . 

It was first studied by theoreticians because of its optimal properties, 
but it is primarily due to several other properties that design engineers 
have begun to use it. The linear quadratic regulator is simple to 
implement provided a full state or at least a reconstructed state is 
available, it has inherent multivariable capability, amd the design 
algorithms are fully computerized. Desirable closed loop properties 
exist such as guaranteed stability, guaranteed gain and phase margins 
[3] , and reasonable eigenstructures . Here we are primarily concerned 
with the relationship between the quadratic weights and the closed loop 
eigenstructure . 

In Chapter II the linear control problems of interest are defined; 
and then the relationships between the feedback gain matrix, the 
quadratic weights, and the closed loop eigenstructure are discussed in 


terms of maps between parameter spaces. Previous results are presented 
in a tutorial style, references are given, and it is noted where the 
new results fit in. Some previous results on treunsmission zeroes are 
presented, also in tutorial style, in the Appendix. 

The new results «u:e now summarized, first for the linear state 
feedback problem auid then for the linear quadratic regulator. In the 
first problem the feedback gain matrix and the closed loop eigenstruc- 
ture are points in parameter spaces, and under certain conditions the 
map between them is one-to-one. In the forward direction this map is 
an analysis problem and in the reverse direction it is a synthesis 
problem (selecting a feedback gain matrix to achieve a specified closed 
loop eigenstructure) . 

If the state feedback matrix is multiplied by a scalar amd this 
scalar is vauried, a curve is traced out in each of the two paramenter 
‘vpaces. Also, the closed loop eigenvalues trace out a multivariable 
root locus on the complex s plane. Chapter III derives equations for 
the angles of the root locus, for the sensitivity of the closed loop 
eigenvalues (how much they chamge with respect to a change in the 
pairameter) , and for the directional derivatives of the closed loop 
eigenvectors . 

As the feedback gain matrix becomes very large the closed loop 
eigenstructure approaches certain asymptotic properties. These proper- 
ties can be parameterized and a map defined between the parameters and 
the feedback gain matrix. Using this map to find a feedback gain matrix 
is a synthesis problem that is solved in Chapter V. It is one of many 
ways to select a feedback gain matrix, but has not to our knowledge 
appeared in the literature. 

A similar procedure is used for the linear quadratic regulator. 
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The quadratic weights and the closed loop eigenstructure are points 
in parameter spaces but the map between them is not one-to-one. Many 
different quadratic weights produce the same closed loop eigenstruc- 
ture. As an analysis problem tliis map has received a lot of attention, 
but as a synthesis problem it has not been used extensively (selecting 
quadratic weights to achieve a specified closed loop eigenstructure 
and then computing the feedback gain matrix) . 

If the weights on the control are multiplied by a scalar and this 
scalar is varied, a ciirve is traced out in the parameter spaces of 
quadratic weights and the closed loop eigenstructures . Also, the closed 
loop eigenvalues trace out a multivariable optimal root locus on the 
complex s plane. In Chapter III the behavior of the closed loop 
eigenstructure is analyzed and equations are derived for angles, sensi- 
tivities, and directional derivatives. The same is done when the 
quadratic weights are dependent in a more general way on a single para- 
meter, and the particular case of analyzing the inverse square method 
of selecting qiaadratic weights is treated. Also, in Chapter V it is 
shown that optimal root loci for so-called "non-generic" problems can 
be approximated with loci of "generic" ones. 

As the control weights become very small the closed loop eigen- 
structure approaches certain asymptotic properties. Some of the eigen- 
values remain finite and others approach infinity. An algorithm is 
presented in Chapter V that determines how many of each there are and 
in what manner they approach their limit. The associated eigenvectors 
are also described. 

The asymptotic properties can be parameterized and a map defined 
between the parameters and the quadratic weights. Using this map to 
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select quadratic weights in a synthesia problem that was first studied 
by Hatrvey and Stein [4] amd later gener?,3.1isiSd by Stein [5] . It turns 
out that many different quadratic weights produce the same asymptotic 
properties, and in Chapter IV an equivalence class of these quadratic 
weights is defined. Sufficient conditions lire given to be in a parti- 
cular equivalence class, a cauionical element is defined, and an 
algorithm is presented which computes the canonical element. Finally, 
the behavior of the optimal root locus for different members of this 
equivalence class is discussed. 

1.2 Notation 

<1 

Matrices are ij,idicated by capital letters. Scalars and vectors 
are indicated by small letters. No underlines are used and whether the 
variable is a scalar' or vector is clear from the context. Subspaces 

XX 

are indicated by script letters, wi-th the exception of the R , the n 
order real vector space. ”Im A" cind "ker A” are the image and kernel 
of A. The symbols E° and E* indicated equivalence classes as defined 

in Chapter IV. A is the transpose of A, cind x^ is the Hermitian 

— T -IT T -1 

transpose of the vectojr x^. A indicates (A ) or equivalently (A ) 

Equations, examples, lemmas, and theorems are numbered starting 
from one at the beginning of each chapter. When referenced from wi-thin 
the same chapter only the number is used, o-therwise C4.1) means the 
first occurence in Chapter IV. 

A permutation ma-trix P is a zero matrix wi-th a one in each row- and 
column. PA reairranges the rows of A and AP rearranges the col-umns of A. 

All of the root locus diagraas are in the complex S plane. The x’s 
are the open loop poles and the O's are the transmission zeroes. 
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Background 

2.1 Introduction 

The linear control problems studied in this thesis are defined; 
and then the relationships between the state feedback gains, the 
quadratic weights, and the closed loop eigenstructure are discussed 
in terms of maps between parameter spaces. Emphasis is placed on both 
the general case of the linear state feedback problem and the special 
case of the linear quadratic regulator. 

2 . 2 Linear Control Problems 
2.2.1 Linear State Feedback 

invariant system with full 

( 1 ) 

(2) 


Consider ttie following linear, time 
state feedback; 

X = Ax + Bu 


u = -f Px. 
k 


where x e R 


n 


u e R 


,ni 


We will always assiame that B is full rank. The matrices (A,B) will be 
either controllable, stabilizable, or neitlier. The closed loop 
system matrix is 


A , = A - i BF. 
cl k 


(3) 


As k is varied from infinity down to zero the closed loop eigenvalues 


trace out a root locus. 


2.2.2 Linear Output Feedback 

The ,>uts amd not the full state are used for feedback. Only 
the case of the same number of inputs and outputs is considered. The 
equations cure 

X = Ax + Bu (4) 

y » Cx 

u » ^ Ky (6) 

, m 

where y e R . 

We make the same assumptions about (A,B) as for the linear state feed- 
back problem- c will always be ftill rank and (C,A) will be either 
observcdsle, detectable, or neither. The closed loop system matrix is 

'‘=1 “ - 1 <■'> 

and k again sweeps out a root locus. 

Important c[uantities associated with the system S(A,B,C) are the 
transmission- zeroes. Here we use the definition of transmission 
zeroes due to Rosenbrock [6] , which is equivalent to the following def- 
inition wiisSn the number of inputs and outputs are equal [7] . The trans' 
mission zeroes are those values of s, not including uncontrollable or 
unobservable modes, which reduce the rank of 

"A-sI B" 

. "C 0. 

See Appendix A for further discussion. 


2.2.3 Linear Quadratic Regulator 


The gain matria. F is chosen so that x and u minimize the cost function 




T T 

(x Qx + pu Ru)dt 


T 

where Q = Q ^0 
T 

R = R > 0 
and 0 < p < » . 


( 8 ) 


The state weighting matrix can be factored into 

T 

Q = MM 

where Rank(Q) = Rank(M) = p and M is p x m. The matrix is arbitraury 

to within a premultiplicatibn by a p x p unitary matrix £W such that 
T 

W W = X) . When Rank(Q) = m then we will use 

T 

Q « H^H, 

where H is m x n. Assume that (A,B) is stabilizable and (M,A) is de- 
tectable. The assxxmptions on Q will sometimes be downgraded to 
symmetric and not necessarily non-negative definite. 

The optimal gain matrix is found by first solving the algebraic 
Riccati equation [2] 

T 1 -1 T (9) 

0 = 0 + A P + PA PBR B P 

P 

to obtain 

1 -IT 

P = - R B P (10) 

P 

u = -Fx . 

The closed loop system matrix is 


A , (p) = A - BF. 
cl 


( 12 ) 


■14 


The parameter p is included to emphasize the dependence of A , on it. 

cx 

As p vcUtI'-jS from infinity down to zero the closed loop eigenvalues 
trace out an optimal root locus. 


2.2.4 Hamiltonian System 

The Hamiltonian system is defined to be 


z = Zz 


where Z = 


and z = 


-Q 

X 

C 


1 -l^T 

BR B 

P 


-A* 


(13) 

(14) 


It is of interest because it describes solutions of the linear cm^dratic 
regulator problem [8] . The eigenvalues of Z are symmetric about the 
imaginary axis. Therefore if s^ is an eigenvalue so is Those in 

the left half plane (LlS>) arc the same as the closed loop eigenvalues 
of the linear quadratic regulator. If (x^"^, C^'^) is cui eigenvector 
of Z associated with a LHP eigenvalue then the portion x^ is an eigen- 
vector of the linear quadratic regulator. Furthermore, 5^ = Px^. 

The following trick is a useful way of applying root locus methods 
derived for linear output feedback systems to the optimal root locus. 

We define a linear output feedback system that has a closed loop system 
matrix equal to the Hamiltonian system matrix. Let 
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then 

Z = A- — iKC . 

P 

As p is varied from infinity dovm to zero the eigenvalues of Z in the 
LHP tract out an optimal root locus. This trace is similar to one 
used by Shaked [9] . 

2.3 Maps 

It is convenient to discuss the linear control problems in terns 
of maps between parameter spaces. This helps to organize the presen- 
tation of previous results and to show where the new results fit in. 

For quick reference the maps are listed in Table 2.1. In the following 
sections each map is defined and discussed. 

2.3.1 LSF Map 

This is a map associated with the linear state feedback problem 
as described in section 2.2.1. Here we think of the control problem 
as a map between the space of m x n matrices and the space of closed 
loop eigenvr.1, aes and eigenvectors. The notation used is 

LSF : F s . , X . . 

1 1 

Given an F matrix it is always possible to. compute A^^ and then to 
compute the eigenstructure of A^^. For the examples in this thesis 
EISPACK [10] subroutines were used to do this. We note here that non- 
trivial nimierical problems arise when the eigenvalues get too close 


together or too far apart. 


Table 2.1 


Forward 


Inverse 


Forward, 
dependent on 
a parameter 


Inverse 

Asymptotic 


Maps 

Linear State 
Feedback 

LSF: F -► 

ILSF; -*■ F 

LSF (k) : i F -)• s . (k) ,x . (k) 

iC Xi X 

0 ^ k ^ ® 

lALSF: lim. s. (k) ,lim x. (k)-»^^P 
k-K> ^ k^ 


Linear Quadratic 
Regulator 

LQR: Q,R -► s^,.x^ 

ILOR: s^,x^ -► Q,R 

LQR( ): Q,pR^Sj_(p) ,x^(p) 

0 < P < -oo 

lALQR: lim s. (p) , 
lim X. (p) -»-Q,pR 
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2.3.2 ILSF Map 

This is the inverse of the linear state feedback problem and the 
notation used is 


ILSF: S. ,x. -► F. 

i 1 

The ILSF map represents a synthesis problem; given a desired eigenstruc- 
ture find F such that the closed loop system has this desired eigen- 
structiir e . 

System controllability is an important issue in the ILSF map. 

Here we think of controllability as the ability to move eigenvalues 

with state feedback. (For a different type of definition see Willems 

and Hitter [11] ) . One way to test for controllability is to pick an 

F matrix by picking at random each element of F from a dense stabset of 

the real mamber line, and then using this F to compute the closed loop 

eigenvalues. Those eigenvalues that do not move are almost surely 

uncontrollable. If all move then the system is controllable. 

A simplified version of the ILSF map is the modal control problem. 

An F matrix is sought which will result in a desired set of eigenvalues, 

called modes. The eigenvectors are not specified. A good treatment 

of this problem is given by Wonham [12] . The main results are given 

in the form of a lemma. The multiple input results are due to Wonham. 

Lemma 1 (A,B) is controllable if and only if there exist F 
matrices (many in general) which place the eigenvalues in 
arbitrary locations. If the system is not controllable then 
only the controllaible modes can be moved. In the single input 
case F is unique. 

Mciny papers have been written about what to do with the extra 
design freedom available when F is not unique. One significant paper 


is by Moore [13] . He shows that the extra freedom can be used to 

select eigenvectors. His main result is: 

Lemma 2 For the case of distinct closed loop eigenvalues 
a unique P exists which places the eigenvalues and eigen- 
vectors at specified locations if and only if the system 

is controllable and for each x. there exists a such that 

1 1 


[A-s^I 



0 


So we see thab the closed loop eigenvectors must lie in certain m 
dimensional subspaces determined by the s^'s. If some of the modes 
are uncontrollable then they must be included in the specified set of 
eigenvalues, but some freedom still exists in selecting the associated 
eigenvectors . 

Moore's proof, is constructive and he gives the following algorithm 
for finding P. Select the desired s^ (distinct) and the desired eigen- 
vectors These eigenvectors may or may not lie in the permissible 

subspace, so compute x^ and by projecting x^^ onto the permissible 
subspace (using, for instance, singular value decomposition) . Then 
form the matrices 


X = [x^, 
N = 




/V ] 
• m 


If 

Im(x^) 


*1+1 ''i' 


, and Re(v^) , 


are complex conjugates replace them by Re(x^) , 
Im(v^) . The gain matrix is then given by 
F = -NX“^. 


In the single input case no extra freedom exists to select the x^ ' s 
because they are each constrained to. a one dimensional subspace. 
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2.3.3 LSF(k) Map 

When k is varied from infinity dovm to zero a family of linear 
state feedback problems is produced, which will be denoted by 
LSF (k) ; i F -»• s . (k) , X . (k) for 0 < k ^ ® . 

As k approaches zero the closed loop eigenstructure approaches certain 

asymptotic properties. As k varies over its range the s^'s trace out 

a root locus, which in the single input case is the classical root 

locus. The multiple input case is more involved and is still an area 

of current research. As k varies over its range the x^'s rotate in 

(if x^ and are complex conjugates then use instead Re(x^) and 

Im(x^)). Historically very little attention has been given to the 

behavior of the x . ’ s . 

1 

In Chapter III some new results are derived about the behavior of 
the closed loop eigenstructure as a function of k. Angles on the root 
locus are defined, and by using the generalized eigenvalue problem 
equations are derived to compute the angles. See Appendix A for a 
brief explanation of the generalized eigenvalue problem. The advantage 
of using it is that angles can be computed when k=0, even though 1/k 
is not defined. Also in. Chapter III, equations are derived to compute 
directional derivatives of the x . ' s . 

2.3.4 Root Locus 

In the single input case the root locus methods of classical con- 
trol can be used to describe the behavior of the closed loop eigenvalues. 

These methods were first developed by Evans in 1948 [14] . They are 

« 

described in Eveleigh [15] , Melsa and Schwartz [16] , and most other 


classical control textbooks. Descriptions of computer aided plotting 
routines have appeared in literature as recently as 1978 [17] . 


For the purpose of auaalyzing the root locus it is always possible 
to rephrase the state feedback problem (1-3) as am output feedback 
problem (4-7) . Simply let KC =» P. 

The starting point for the classical root locus is the output 
■feedback problem with a single input amd output. The time domain des- 
cription (4-6) is Laplace Transformed in order to get the following 
transfer fimction, which is the ratio of two polynomials: 



c(sl 



a 


N(S2 

D(s) 


P 

where N(s) = H (s-z.) 

i=l 


n 

amd D(s) ® n (s-p. ) . 
i=l . 


The z^'s are tramsmission zeroes and the p^^'s are open loop poles. The 
feedback loop is closed by letting 

u(s) ^ y(s) + u(s) , 

where u(s) is am external input. The closed loop transfer function is 


y(s) 

u(s) 


g N (s) 

D(s) + N(g) 


(15) 


The closed loop eigenvalues are those values of s which make the denomin 
ator equal to zero, and may be plotted as a function of k. 

Generalizing the classical root locus methods to the multiple 



input case has proven to be a difficult task. Kouraritakas , Shaked, 
cuid Postlethwaite [18-22] have addressed various aspects of the problem. 
Progress was slow at first due to a debate over the definition of multi- 
variable transmission zeroes. That debate is beginning to subside and 
attention is shifting to the behavior of modes that asymptotically 
approach infinity. 

As is often the case in control theory, root locus problems can 
be attacked with either time or frequency domain techniques. In the 
frequency domain, the closed loop transfer function must be replaced 
by a transfer function matrix. Then the closed loop poles are no 
longer characterized by the denominator in (15) but by an algebraic 
function (a polynomial in s with coefficients that are polynomials in 
k) . In order to discuss solutions of this algebraic equation concepts 
such as Riemann surfaces must be introduced. Asymptotic results can 
be found by using a Newton chart. These complications are sidestepped 
here by staying in the time domain whenever possible. 

Of particular interest is the case when Rank(CB) =» m. Why this 
case is of interest is motivated by Wonham [12] , and also [18-22] . 

This is called the generic case, and it is the only one that will be 
reviewed in depth. The word "generic" will be used to describe a pro- 
perty which holds everywhere on a set of points except those belonging 
to a mathematical variety. A "variety" is a locus of points which satisfy 
a finite number of polynomials [12] . In this case the property is that 
Rank(CB) = m. The only points for which this property does not hold 
is when the polynomial det(CB) = 0. In the following example Rank(CB)<m: 


— 1 

o 

o 

H 


i 

H 

O 

1 

o 

o 

1 

o 

H 

O 

II 

m 

u 


0 1 

— 1 

H 

O 

II 


1 

O 

O 

1 
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This is the nongeneric case. However, if the 1,1 element of C is per- 
ttirbed gn arbitraurily small amoiint e then Rank(CB) » m, which is the 
generic case. 

The following facts are known about the multivariable root locus 
for the generic case. We assume that (A,B) is controllable and that 
KCB has no Jordan blocks of size greater than 1x1. Then 

1) The root locus has n branches, and these eire symmetric cdxsut 
the recil axis. 

2) For large k the branches originate at the open loop poles. 

3) For m=l etnd a>0 (<0) , where a is defined in (15) , the real 
axis to the left (right) of an odd number of singularities lies 
on the locus. This rule does not apply when m>l. 

4) As k 0, (n=m) of the branches stay finite. These are 
characterized by 


S° =* diag (s^° , . . . , 



° 1 
fX 1 

n-m 


r 


where each pair s.°, x.° is a solution of the generalized eigen- 
value problem 


A-s . °I 
1 


X . 
1 


= 0 . 


The (n-m) finite branches approach the transmission zeroes , 
and the eigenvectors approach the zero directions x^° . 

5) As k 0, m branches tend to infinity. These are characterized 
by 

CO CO 00 

S = diag(s^ ,...,s^ ) 

CO OO CO 

N = [V. ], 

1 Id 

CO OO, 

where each pair s^ ' i® a solution of the eigenvalue problem 


(s. I - KCB)v. = 
1 1 


0 . 
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The m branches approach infinity along asymptotes that have angles 
with respect to the positive real axis given by arg (-s . ) , where 
'*arg(x)'' means the argiament of the complex number x. ihe asymptotic 
radius is |s^ [/k- The associated eigenvectors approach If 

the s^“ are not distinct then the eigenvectors are arbitrary to 
within a subspace. 

Some results axe available for the root locus in the nongeneric 
case [18,22] . The final answers are not in yet and the state of the 
art is best described as messy. As k ->■ 0, fewer than (n-m) modes re- 
main finite, and these are characterized by the same generalized eigen- 
value problem. The rest of the modes group into m patterns that 
approach infinity. The asymptotes of each pattern meet a pivot point. 


2.3.5 Definition of Angles 


There are n values of s . on the root locus for each value of k . 

X 

If k is perturbed an amount Ak then each s^ will be perturbed by a 
(possibly very large) amount As^. As Ak ->■ 0 then As^/Ak will approach 
the constant ds^/dk, and the angle on the root locus is defined to be 

arg(ds^) . 

The angles at the open loop poles (k «>) will be called "angles of 
departure", and the angles at the transmission zeroes (k ->■ 0) will be 
called "angles of arrival". An example of angles on the root locus 
is shown in Figure 2.1. 

For the single input case standard root locus formulas are available 
to find the angles of departure and approach. Postlethwaite [21] extends 
these results to the multiple input case using frequency domain methods. 
Shaked [19] does so using time domain methods. Here we use new time 
domain methods (the generalized eigenvalue problem) to extend Shaked 's 


results. 
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Figure 2.1 
Definition of Angles 
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2.3.6 lALSF Map 

This is called the inverse asymptotic linear state feedback map. 

It is the inverse of the LSP(k) map as k -»■ 0 and is denoted by 

lALSF; lim s. (k) , lim x . (k) ^ F. 

k-KI ^ k-K) 

The IMjSF map represents a synthesis problem; given the desired 

asymptotic properties of the LSF (k) map characterized by 

o 0 00 » 

S , X , S , and N ; 

find F such that the closed loop system has these desired asymptotic 
properties. This problem is solved for the first time in Chapter V. 

It is sims.lar to synthesis problems solved by Moore [13] , Harvey and 
Stein [4] , and Stein [5] . 

2.3.7 LQR Map 

This map is associated with the linear quadratic regulator as 
described in section 2.2.3. Here we think of the regulator as a map 
between the matrices Q and R and the closed loop eigenstructure . The 
notation used is 

LQR; Q,R -»■ S^,x^. 

The LQR map is one of the cornerstones of modern control theory. Major 
credit is due to Kalman [23] . 

The steps used to compute the closed loop eigenstructure are 

symbolically shown by 

Q,R^-P ->■ F A T s.,x.. 

^ cl 1 X 

The most important step is first finding the Riccati solution. Wonham 


[24] gives the necess^:y and sufficient conditions on A, B, Q, R fpr 
the existence of a stcdsle closed loop solution. 

An active aurea of reseaurch is developing algorithaas to compute 
Riccati solutions. One standaurd way is to use the eigenvectors of the 
Hamiltonian system matrix [8] . This method is usually referred to in 
the control literature as Potter's method but it predates him, (see 
the references of [25] ) . The method is symbolically shown by 

Q,R ->• Z ^ P. 

A variation of this method with improved numericaLL properties is by 
Laub [25] and uses the Schur vectors of Z. 

For the example calculations used here we were not interested in 
P or F, so the following shortcut was used to find the closed loop 
eigenstructur e : 

Q,R -»• Z -*■ s. ,x. . 

^ i' 1 

A simple example shows that the Q and R matrices that produce an 
opti m al gain matrix (amd hence a closed loop eigenstructur e) are not 
unique- Multiply Q and R by the same positive constant a. Then the 
Riccati solution changes from P to aP but F stays the same. Therefore . 
we can define a mathematical equivalence class [26] of Q and R matrices 
in terms of the property that they produce the same optimal gain matrix. 

Perhaps not so well known is that any Q with Q ^ 0 and Rank(Q) > m 
is equivalent (in the sense used above) to a Q with Rank(Q) = m. This 
result is used and discussed by Molinari [27] and Harvey and Stein [4] , 
and is due to Popov [28] . As a consequence it is always possible to 
define a response vector 

r = Hx 


where r e R™ 
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- T 
Q = H H, 

and such that Q is equivalent to any specified Q. The system S(A,B,H) 
is important to this thesis. 

Necessary and sufficient conditions for (Q,R) and (Q,R) to be in 

the same equivalence class have been developed by Molinari [27] and 

Jameson and Kriendler [29] . Molinari constrains R so that R=I and 

T 

presents the following result (which is also valid for any R = R > 0) : 

Lemma 3 Assume (A,E) is controllable and F is optimal for some 
(Q,R) . Then (Q/R) is in the same etjuivalence class if and only 
if there exists a real symmetric Y satisfying 

(i) Q = A - a'^Y - YA 

(ii) YB = 0, 

. -1 T 

The Rxccati solution changes from P to P+Y, but P = -R B (P+Y) remains 

T 

constant becuase B Y = 0. There is no guarantee that P+Y ^ 0 or Q ^ 0. 
When R is not constrained to be constant then a similar result can be 
extracted (with some difficulty) from the paper by Jameson and Kriendler. 

2.3.8 ILQR Map 

This map describes the inverse of the linear quadratic regulator 
and is denoted by 

ILOR; s.,x. «> Q,R. 

The ILQR map represents a synthesis problem and can, in principle, be 
used to select quadratic weights. This turns out not to be very prac- 
tical, as we will show in the following discussion. The asymptotic 
version of this map, presented later, is much more convenient. 

The first step is to find the feedback gain matrix which produces 
the desired eigenstructure . To do this use the ILSF map discussed in 
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section 2.3.2 (specificeLlly the cd.gorithsi due to Moore [13]). If (ArB) 
is controll2d3le then the can be located auiywhere, auid the must 
lie in certain m dimensional subspaces. 

If the feedback gain matrix exists then a check can be made that 
it is optimal for some (Q/R) . Kalman [30] solved tills problem for 
the single input case. Anderson amd Moore [13] generalized this result 
to the multiple input case. The version of this result presented here 
is due to Molinari [27] . 

Lemma 4 Assume^ (A, B) is controllable and R=I. Then P is optimal 
for some Q = Q ^ 0 if and only if s. <0 and 1“ ( ju))T( joi) ^ I, 
where T(s) = I + P(Is-A)"^ B. ^ 

Unfortunately this result is difficult to implement because it must be 

true for all oj. If Q is only required to be symmetric then we have the 

following result, auLso due to Molinauri. 

Lemma 5 Assume (A,B) is controllable amd R«I. Then F is optimal 
for some Q =« if auid only if s^ < 0 amd PB is symmetric. 

Jameson and Kriendler [29] extend this result to a'more general class of 

A, B, and R matrices, again only requiring that Q be symmetric. 

If the check on F succeeds then F is optimal for some (Q,R) . 

Jameson and Kriendler give an algorithm that can reach every (Q,R) in 

the equivalence class of matrices that produce the same F (there! is no 

guarantee that Q ^ 0) . However, if the check on F fails then no hint 

is given as to how F, s^, or x^ should be changed. This is the main 

problem with using the lALQR map as a way to select quadratic weights. 

We note here that T(s) defined in lemma 4 is the return difference 

equation for the system S(A,B,F) , and as such it plays a fundamental 

role in control system design. It is used to measure the disturbance 

rejection properties of the system the ability of the system to follow 

commands, and the robustness of the system. 


when p is varied from infinity down to zero a family of linear 
quadratic regulators is produced, which will be denoted by 

LQR(p) ; Q, pR -»■ S^(p) , X^(p) for 0 < p < “. 

Only the case where R is linearly dependent on p is considered. Similar 
results, especially for eigenvectors, do not necessarily hold when Q 
and R are dependent on p in an arbitrary way. The closed loop eigen- 
values trace out an optimal root locus. Its behavior is studied, as 
described in section 2.2.4, by using the Hamiltonian system. Of special 
interest is the asymptotic behavior of the s^(p) and x^Cp) as p -♦■0. 

Several new results are derived that concern the LQR(p) map. In 
Chapter III equations are derived that compute angles on the optimal 
root locus and directional derivatives of the x^(p). In Chapter V an 
algorithm is presented that computes the asymptotically infinite be- 
havior of the optimal root locus, and a result is presented that 
shows how an optimal root locus can be approximated by another. 

2.3.10 Optimal Root Locus 

In the single input case the optimal root locus can be described 

using classical root locus technic[ues. The trick is to recognize 

that the optimal closed loop poles are the left half plane eigenvalues 

T 

of detCsI-Z) =• 0. Assume that Q = h h, where h is 1 x n, and that 
R = r > 0. Then by using determinant identities it can be shown that 
[ 8 ] 


det(sI-Z) = (-1) ^[(j) (s) (j) C-s) + i|;(s)i(;(-s)] 


(16) 
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n 

where i|)(s) » det(sI-A) » H (s-p.) 

i-1 ^ 

T -1. ^ 

and ^(s) » (^(s)h (sI-A) oH (s-z. ) . 

i-1 

The Pj_'s are the open loop poles and the z^'s are the trzmsmission 
zeroes of the system S(A,b,h). Equation (16) is emalogous to the 
denominator of (15) . 

Before the heyday of Kalman, state space techniques, and Riccati 

equations it was recognized by Chang [32] that (16) can be used to 

plot the single input optimal root locus. He suggested using the 

root square locus, which is donfe by rewriting (16) as a polynomial in 
2 

s' * s , and then plotting the classical root locus on the s’ plane. 
Kal m a n [30] and Kwakemaak and Sivan [8] give rules for plotting the 
single input opti m al root locus on the s plane. These rules involve 
plotting (16) on the s plcuie using classical root locus techniques amd 
then only keeping the left half side. 

Now we move on to the multiple input case of the optimal root locus. 
Rynaski [33] developed a multivariable version of the root square locus, 
but it is very cumbersome even for the case of two inputs. The proce- 
dure used here is to use the Hamiltonian system S(A,B,KC) and apply 

the multivariable root locus results [34] . The generic case is when MB 

T 

xs full rank (where Q = M M) . Both this and the nongeneric case will 
be reviewed. The symmetry about the imaginary axis of the eigenvalues 
of the HamiltonicUi system makes the analysis easier. The notation used 
here is the same as used by Stein [5] . 


1) The optimal root locus has n branches, which stay entirely in the 
LHP, and are symmetric about the real axis. 


2) For p Icurge the branches originate at -|Re p^j + j Im p.. 

(This is equal to p. if p. is in the I<HP, otherwise to the mirror 
image of p^ about tAe imaginary aucis) . 

3) For m*l and (n"P) even (odd) the negative real axis to the left 
of an odd (even) number of singularities lies on the locus. This 
rule does not apply when m > 1. 

4) As p -»■ 0, p of the branches stay finite. These are characterized ] 

by I 

J 

S° = diag(s^ , . . . ,s^ ) j 

X° = [x^° , . . . ,Xp° ] , I 

where each pair sP , x.° is a solution of the generalized eigen- ^ 

value problem | 



If H is available then a lower dimensional generalized eigenvalue ' « 

problem can be solved using the system S(A,B,H). If s. and x. are ] 

the finite solutions then s.° =-lRes.| +j Ims., buA x ° = x . 
only if the corresponding s. is in the LHP . The p branches that 
stay finite approach the and the associated eigenvectors 

approach the x . ° . In the generic case p = n - m , in the non- i 

generic case 0 < p < n - m > 


5) In the generic case the asymptotically infinite behavior is 
characterized by 


S = diag(s , . . . ,s ) 
1 m 




CO 

N 




■ J , 


m 


00 00 

where each pair s . , v . is a solution of the eigenvalue problem 


0 . 




) I - H 


“i 


B 


"qb]v^ 


The a branches which approach Ixifihit^ stay on the negative 
real axis with an asyn^totic radius of s.“/p^ . (These are first 
order Butterworth patterns, contrary to Bonham [12] p» 318) . The 
associated eigenvectors approach Bv^“. 

6) In the nongeneric case the infinite behavior is characterized 
by the same s“ amd N* and also by a multi- index y. The (n-p) 
branches that approach infinity group into m Butterworth patterns. 
The ith pattern is n.th order, with asymptotic radii equaJ. to 



Properties of Butterworth patterns are summarizi'd in Table 2.2. 
There are n^ vectors which form a basis for the subspace associated 
with each pattern. These are 


_ OB _ _ 09 . AA* — 09 

Bv^ , ,...,A ^ BV^ . 

The multi- index y lists the n^'s in the following way; 


y — (01 , 11 , 21 , . . . , [n_ — l] 1 , 02 , . . • , [n_— 1] 2 , . . . , [n — 1] m) 

j. ^ m 


If we define the controllability matrix 

a = [BN®, . . . ,ABN®, . . . BN®] , 


vdiich is an n X ( nm) matrix, then each term (i,j) of the multi- 
index defines the column A^BVj“ of U. The collection of all 
colimns defined by y we call u , therefore 

= [Bv “, . . . ,a"1”^Bv ®, . . . ,a”™“^Bv ®] . 

X X m 

The columns of form a basis for the srobspaces spanned by all m 
Butterworth patterns. In the generic case = BN". 

Computing s“, N°°, and y in the nongeneric case is numerically 
an ill-posed problem because arbitrarily small changes in B or H 
cause the problem to become generic with only first order patterns. 
The s^"'s and v^®'s associated with first order patterns are the 
nonzero solutions of the eigenvalue problem given in step 5. 
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The results for the multiple input case have been established 
over the last several years. The attraction of the finite branches to 
the transmission zeroes of S(A,B,H) is stated in Kwakemaak and Sivan 
[8] . Both Kouveuritakcis [34] amd Shaked [19] use the Hamiltonian 
system to find the teansmission zeroes. Neither use the generalized 
eigenvalue problem, as done here, which can easily be used to compute 
the trcunsmission zeroes amd angles of aurrival. Kweikernaak and Sivaui 
[8] conjecture that the infinite modes group into Butterworth patterns, 
and KwaJcernaiak [35] later used some algebraic function theory, to prove 
this. Wonham [12] gives a theorem which describes the behavior of the 
opti m al root locus in the generic case. The asymptotic behavior of the 
eigenvectors was established by Harvey and Stein [4] in the generic 
case and by Stein [5] in the riongeneric case. Algorithms to find S* 
and y are given by Shaked [19] and Postlethwaite [36] , but neither 
addresses the inherent numerical instability of their solutions. An 
algorithm to find S“, n“, and y is given here in Chapter V. 

2.3.11 The lALQR Map 

The last of the maps to be defined is the inverse of the LQR(p) 
map as p 0 , eind it is denoted by 

lALQR: lim s. (p) , lim x. (p) ->• Q,pR. 

p-^ p-K) 

This again represents a synthesis problem: given the desired asymptotic 

properties of the LQR(p) map characterized by 

Q 0 

S , X , S , N , and y; 


find Q and R such that the optimal regulator has these desired properties. 
This synthesis problem is posed aind solved by Harvey and Stein [4] in 
the generic case and by Stein [5] in the nongeneric case. 

The algorithm presented by Stein starts with the following assump- 
tions; The S° matrix has p stable diagonal elements. The p coltamns 
of X° are linearly independent and for each there exists a such that 

CA-s.°lx.o + Bv.° = 0. Furthermore, the x.° do not lie in the image of 
111 1 ’ 

Y 0 

U . CTo avoid complex arithmetic S can be made block diagonal and 
the complex conjugate columns x^ and cam be replaced by Re x^ amd 

oa , 

Im x^) . The S matrix has m nonzero and positive diagonal elements. 

00 

The N matrix in invertible, and the multi-index y is such that 

n-+...+n =n~p. 

1 m 

Let P be a permutation matrix that switches around the columns of 

Y , Y 

U in an arbitrary manner except that the last m columns of U'p are 

Hi -“1 ri — 1 00 

A 1 Bv, , . . . ,A ^ Ev . Then we have 
1 m 

Lemma 6 The quadratic weighting matrices (not unique) that produce 
the desired asymptotic properties are given by 

H = [0,1] [X°, D^P]"^ 

R = (n“)’-'^(s“)-^n“)-^ 

Q = H^H. 

The last step in the synthesis problem is to solve the linear 
quadratic regulator problem for several values of p and "trade off" 
control energy with eigenvalue and eigenvector placement. 

2.3.12 Selecting Quadratic Weights 


The following quote from Athans [2] in 1971 is still true today. 


The selection of weighting matrices in the quadratic 
criterion is not a simple matter. Usually they axe 
selected by the designer on the basis of engineering 
experience coupled with alternate simulation runs for 
different trial values. There is no laniversal agree- 
ment on precisely how these are to be selected for any 
given application. 

At the heart of the problem is that many different and sometimes 
contradictory specifications have to be lumped into a single cost 
function. Over the years several ad hoc methods have been developed, 
the best known being the inverse square method due to Bryson. A few 
renarks cure made in Chapter III about this method. See the references 
in Harvey and Stein [4] for other methods. Hone can be considered 
uniquely satisfactory. 

Some encouraging progress has been made on the problem of selecting 
cpaadratic weights to produce a desired asymptotic eigenstructure. The 
algorithm due to Stein [5] presented in the previous section is an 
example of this. There remain, however, other types of specifications 
\diich cannot adequately be described using a closed loop eigenstructure. 
For example, constraints may exist on feedback gain levels, or adequate 
stability margins may have to be assured. The relationship between 
quadratic weights aind these types of specifications needs further 
research. 
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CEAPTER III 
Angles 


3.1 Introduction 

Equations are derived for the angles on the root locus of the out- 
put feedback problem. The angles can be computed at any point including • 
the points of departxare and approach. By using the generalized eigen- 
value problem the angles of approach can easily be computed. These 
results are then applied to the optimal root locus of the linear 
quadratic regulator by using the Hamiltonian system. Equations are 
also derived to find the sensitivity of the closed loop eigenvalues and 
the directional derivatives of the closed loop eigenvectors. Finally, 
a more general dependence of Q and R on p is considered and equations 
for angles and sensitivities are used to analyze the inverse square 
method of selecting quadratic weights. 

Only the case of distinct closed loop eigenvalues is considered. 

The equations derived in this ghapter are not valid at the points 
where there are multiple closed loop eigenvalues, and the equations 
cannot easily be extended to handle these cases. 

3.2 The Ouput Feedback Problem 

3.2.1 Finding the Closed Loop Eigenstructure Using the Generalized 
Eigenvalue Problem 

The closed loop system matrix for the output feedback problem is 

A^^ = A - i BKC. (1) 

The closed loop eigenvalues, eigenvectors, and left eigenvectors are 


defined in the usual way by 


(A 


cl 


3 ^ 1 ) = 0 


( 2 ) 



(A 


'cl 


S.I) 


0 


C3) 


How we state a leama which we shall use in the remainder of this 
chapter. 

5- jj 

Lemma 1 The S . , x^ , and y^ are solutions of the generalized 
eigenvalue pr^lems ^ 



0 


0 


(4) 


(5) 


Remark k=0 is now allowed, in which case (4) and (5) can be used 
to find the transmission zeroes, zero directions, and left zero 
directions . 


Remark When k > 0 there are exactly n finite solutions to (4) 
and (5), and when k=0 there are anywhere from 0 to n-m finite 
solutions. 


To prove lemma 1, from (4) we see that 

(A-s.I)x. + Bv. 

11 1 

V. 

1 

{A-s.I)x. - ~ B K C X. = 0, (6) 

X X ic ^ 


= 0 

= - r K c X. 
k 1 


and then (2) follows immediately from (6) . Therefore the s^ and x^ 
that are solutions of the generalized eigenvalue problem are the closed 
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loop eigenvalues and eigenvectors. In a similar way (5) can be reduced 
to (3) , and the proof is complete. 

Lemma 1 is not a new result, but it is not well known. Its proof 
is simple and direct, and it provides valuable insight into the feedback 
control problem. For example, Laub used this result to show the 
relationship of two methods of computing transmission zeroes (see 
Appendix A) . It turns out that the ' s and n ' s can be used to com- 
pute angles of arrival to the trainsmission zeroes. 


3.2.2 Finding ds./dk Using the Eigenvalue and Generalized Eigenvalue 
Problems 


In the eigenvalue problems (2) and (3) the first derivative of A^^ 
with respect to k exists everywhere in the open interval (0,®) . We use 
this fact to find ds^/dk, the derivative of the closed loop eigenvalue 
with respect to k. 

Lemma 2 For any k in the interval (0,®) , and for any distinct s^. 


ds. 
1 

dk 


_ 1 _ 

k2 


y.^ B K C X. 
X -X 


H 

y. X. 

•*4 X 


(7) 


To prove lemma 2 differentiate (2) to g®t 


^ (A ,-s.I) X. + (A -s.I) X. = 0. 
dk cl 1 X cl 1 dk 1 


( 8 ) 


H 

Multiply on the left by the left eigenvector y^ , which cancels the 
second term and leaves 


H — A ,-s.I X. = 
y. dk cl X X 

X 


0 . 


Reau:T 2 mge to ge-t 



Differentiate A , to get (7) . It is always possible to normalize the 

Q± 

eigenvectors so that y^ * 1, in which case the denominator in (7) 

can be removed. This completes the proof. 

Lemma 2 is a standard result that can be extracted from the 

higher mathematics of Kato [37] . Wilkinson [38] gives a more readable 

derivation of a similar result - the sensitivity of s . to changes in 

A . . Shaked [19] derives and uses (7) . 
cx 

In the generalized eigenvaiLue. problems (4) and (5) the first 
derivative of the large matrices with respect to k exist everywhere in 
the semi -open interval [0,») . We use this fact to again find ds^/dk. 
Lemma 3 For any k in the interval [O,®) and for any distinct s^. 


ds . 

X 

dk 


-n. K n- 

X X 

H 

y. X. 
■'x X 


(9) 


To prove lemma 3 use obvious substitution of (4) to get 


[L(k) - s^M]v^ == 0. 


Differentiate to get 


_d_ 

dk 


dv. 

(L - s.M) V. + (L - 

XX X ' dk 


= 0 . 


Multiply on the left fay the left eigenvector, call it , which will 
cancel the second term and leave 
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dk 


CL - SJi) 


V. 

i 


0 . 


Rearrange to get 


ds. 
i 

dk 



Differentiate L and substitute back the original terms to get C9} • 

This completes the proof. Stewart [39] has worked on a problem similar 
to this - the sensitivity of s^^ to changes in L and M. 

3.2.3 Angles on the Root Locus 


Theorem 1 The angles on the root locus, for any value of k in the 
interval [0,<»] and for any distinct s^, are found by 


arg Cds^) 



0 < k < 00 


CIO) 



Cll) 


Remark The angles of departure are found using (10) with k = oo 
(to be more precise, let I = 1/k and use Jl = 0) . The angles of 
approach are found using (11) with k = 0. 

Remark (10) is due to Shaked [19] , (11) is new. 

We prove theorem 1 by showing' (10) and then (11) are correct. To 


derive (10) start with (7) of lemma 2, the formula for the derivative 
of ail eigenvalue. We have that 




y.^ B K C X. 
X X 

H 


X. 

X 



arg 


euui then the amgle is 




Now arg(-l) * ISO®, amd because k, is positive and varies negatively 

2 

from infinity to zero it follows that argdA ) •=* 0® and arg(dk) =» 180 
Therefore (10) is true. 

We Ccuinot use k-0 in (10) becuase A . is not. defined for k^O. It 

cl 

is very awkward to use a limiting argument as k 0 (as does Shaked 
[19]) because Cx^ -*■ 0 and *►0, as seen from (4) and (5) . 

To derive (11) staurt with (9) of lemma 3, the formula for the 
derivative of a generalized eigenvalue. We note that (9) is well 
defined for k=>0. The formula for the angle is 

arg(ds^) * arg(dk) + arg(-l) + arg 

Since argCdk) » 180® and arg(-l) = 180®, (11) follows. This completes 
the proof. 

When k is in the interval (0,®) either (10) or (11) can be used 
to find angles. To show this we note from (4) and (5) of lemma 1 that 

Cx. = -k 




Substxtute these into (10) , and the result by inspection is (11) . 
Except for k very close to or equal to zero, (10) is better to use for 
computing angles because it involves solving an eigenvalue problem of 


lower dimension than the corresponding generalized eigenvalue problem. 
When k is very close to zero, however, (11) is a more reliable equation 


The tradeoffs when k is very close to zero are the same as those for 
solving transmission zeroes using (2) , an eigenvalue problem with high 
gain feedback; or (4) , a generalized eigenvalue problem. Laub [40] 
gives a good discussion of these tradeoffs and concludes that the 
generalized eigenvalue problem is better (for computing transmission 
zeroes) . 


3.2.4 Sensitivity of the Closed Loop Eigenvalues 


For each eigenvalue.- on the root locus we can write the approxima 


tion 


ds . As . 

i. i. 

dk ^ Ak ■ 


Therefore 


As^ 


The term |ds^/dk| is defined as -the sensitivity of s^. One use of the 
sensitivity is that to a first order approximation a change I Ak 1 will 


move the closed loop eigenvalue s^ a distance |As^| in the direction 
arg(ds.). It is immediate from lemmas 2 and 3 that 
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Lennna 4 For any k in the interval [0 , «] and for any distinct s ^ , 


ds. 

X 


y^^ B K C x^ 

dk 

k^ 

H 

y . X. 
•'x X 


0 < ic < as 


C12) 



0 < k < aa. 


C131 


Wilkinson [38] discusses in detail the sensitivity of eigenv8d.ues 
and eigenvectors, including the case of multiple eigenvalues. It 
turns out to be much easier to derive bounds on jds^/dkj for the multi- 
ple eigenvalue case them to derive an expression for ds^/dk. For our 
purposes we will continue to assume that the eiger values are distinct. 


Example 

Several root loci are plotted for eui output feedback problem, and 
the angles are computed in order to verify the preceding results. The 
same system S(A,B,I0:) is used as by Shaked [19j , 


A * 


’-4 7 -1 is' 


’ 0 

1 

0 3 0 2 

B » 

1 

0 

4 7-4 a 


2 

0 

0-1 0 0 

B - 


-2 

0 


[ 0 -5 2 - 2*1 

8 -14 0 2j 


Three different output feedback matrices are used, Shaked used K = I. 


Caso 

# 1 

Cs.sB $ 2 

Case 

# 3 

K = 

10 0 
0 1 

II 

H 

K = 

*10* 

0 50 




Table 3.2 

Points and Anales on the Root Loci of Example 3.1 


Angles are in peirentheses 


Left half plsine 



- 4.45±2.02i 

(+ 177°) 

-11.4 (180) 

-5.16 (0) 

-84.1 (180) 

-6.69 (180) 

-8x10^' (180) 

-3x10® (180) 

- 4.10±2.06i 

(± 151) 

- 4.S6±2.40i 

(± 161) 

-10.34±0.71i 

(+ 113) 

-8x10® (180) 

-3x10® (180) 

- 5.85±3.18i 

(± 161) 

-20.5 (180) 

-8.7 (0) 

-37 (180) 

-8.6 (180) 

159 (180) 

-12.0 (180) 

1.5x10® (180) 

-8x10® (180) 


Right half plane 


1.14 (0°) 

1.94 (180°) 

1.65±0.42i 

(± 

81) 

1.53±0.85i 

(± 

137) 

l.OOil.OOi 

(+ 170) 

1.15±(0) 

1.! 

33 (180) 

1.81±0.65i 

(± 

57) 

2.34±1.33i 

(± 

85) 

l.OOil.OOi 

(+ 

121) 

2.57±1.16i 

(± 

15) 

4.20±0.48i 

( + 

62) 

4.01 CO) 

5.00 (0) 

3.84+1.75 

(± 

140) 

l.OOil.OOi 

(+ 

114) 


SSiKfiiB 
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Numerical results are civen in Tables 3.1 and 3.2, and the root loci 
are clotted in Figure 3.1. 

As expected in all three cases the branches of the locus depart 
from the open loop poles. Two of the brsmches stay entirely in the LHF 
with different angles of depeirture in three cases. The branches 
meet on the negative real axis emd then continue in opposite directions 
as might be expected in the single input case. However, the branch 
that goes to the right eventually turns around, and then both branches 
approach infinity on the negative real axis with different asymptotic 
radii in each case. The other two branches stay entirely in the RHP, 
so the system is always unstable. These branches eventually arrive at 
the transmission zeroes at 1 ± i with different angles of arrival in 
each case. The path taken in the third case is unusucG..,. ;to say the 
least. 

SheJced's paper from which this example is taken contains some 
errors which will be pointed out here. His calculation for the angles 
of departure contains nisnerical errors. More importantly, his formula 
for the angles of arrival (3.16b) is incorrect due to an error in 
the derivation cifter (3.15). This leads to the incorrect conclusion 
that angles of arrival are . independent of the output feedback matrix K- 

3.3 The Linear Quadratic Regulator 


Theorem 2 The angles on the optimal root locus, for any value of p 
in the interval [0,«] , and for any distinct s^, are found by 


arg(ds^) 


= arg 


-1 

w, z. 
li 1 


V 


-1 T 
0 BR B 


,0 < p < «> (14) 




arg (ds^) 



0 < p < « 


(15) 


Remark The angles of departure aire found using (14) with p = 
and the angles of arrival by using (15) with p = 0. 

Theorem 2 is proved by applying (10) and (11) of theorem 1 to the 

Hamiltonian system S(A,B,KC). The vectors and w^ are the right and 

left eigenvectors of Z, the Hamiltonian system matrix; and the vectors 
H 

and ai'S found by solving generalized eigenvalue problems analogous 
to (4) and (5) . Note that 


BKC 


-1 T 
0 BR B 

0 0 


This completes the proof. An example of an optimal root locus is 
given in Chapter IV after a discussion of asymptotic equivalence classes. 

The sensitivity of the optimal closed loop eigenvalues is found 
by applying (12) and (13) of lemma 4 to the Hamiltonian system. 

The number of computations needed to compute (14) and (15) can 
be reduced by using the following identities. First, using (4) and (5) 
it can be shown that 


V. 

1 


= 


H H H 

Now let z^ = (x^ ' ^i ^ eigenvector associated with s^ in the 

H H H 

LHP , let s . be the mirror of s . in the RHP , and let s . = (x . , C • ) 

X X XXX 


be the associated eigenvector. Then 



We fotind ds./dk for the eigenvalue problem in section 3.2.2. 

Now we continue that discussion amd find dx^/dk. The references are 

again Kato [37] and Wilkinson [38] . The results are 

Lemma 5 For any vatlue of k in the interval {0,«) , and for any 
distinct s . , 

i 


dSi 

’diT" ®ii 


dx. 

i 

dk 



+ 



V. 

X 


n 

2 

j=l 


s.-s. 
■ 1 : 


b. 

X 


H . 

-X. V. 
X X 

H 

^i *i 


(16) 

(17) 


(18) 


Equation (16) is derived in section 3.2.2 and is included here for 
convenience. To derive (17) we will need the following: 



(19) 


This can be explained as follows : x^ (k) and (k+Ak) can be normalized 

to lie on the same hypersphere , as Ak ->■ 0 then [x^ (k+Ak) - x^ (k) ] /Ak 
dXj^/dk, ^diich is tangent to the hypersphere, and therefore is orthoganol 


tow, 


since the eigenvectors x. foirm a basis for we can write 


to X. . 
X 
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( 20 ) 


dx. 
1 

dk 


= Xb, 


(21) 


where b and c are vectors and b^ and cire components of these 
vectors. Substitute (20) and (21. into (8) to get 


(A , - s.I)Xb = Xc. 
cl 1 


(22) 


Multiply C20) on the left by note that = 0 for i j , 

and then after some algebra 


C. = 




j 5^ i 
j = i 


By manipulating (22) we see that (Sj-s^)bj = c^ for j=l,...,n. Solve 


for b . to get 


b. = 


s .-s . 
D 1 


j 7^ i 


(23) 


undeteimiined j = i 


Substitute (23) into (21) to get (17) . The only thing not determined 

H 

is b^, which we can find by multiplying (17) on the left by to get 


dx . 

H i H . .. , . H 

X. -TT— = x. V. + b.x. X. . 
1 dk XI XXX 


By (19) the left hand side is zero, and therefore (18) follows. This 
completes the proof of lemma 5. 

The directional derivatives for the optimal eigenvectors can be 
found in a similar way. Use (17) with the Hamiltonian system to get 
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dz, 

1 

dk 




f 


auid then extract dx^/dk. 


3.5 Inverse Square Quadratic Weights 


One comaon ad hoc method for selecting quadratic weights is the 
inverse square method. Here we give a brief explanation of the method 
and show one way to analyze it if the first guess of quadratic weights 
is not satisfactoiry. 

Start with the quadratic cost function 



(x^2x + u"^Ru)dt. 


Require that Q and R be diagoneil, and then the cost function can be 
rewritten 


J 



%i 



+ 


m 

E 

i»l 



Decide on a may imuni allowaJble deviation for each state suid control and 

call these x. and u. . Then select the weights so that each 
imax imax. 

term has equal contribution to the cost function at maximvim deviation, 

i.e. 


•^ii = 


imax 


r. . 
11 


1 


2 

u. 

imax 


With Q and R chosen in this manner, compute the optimal gain matrix. 
If the system behaves well with this controller then do not make any 
changes in Q and R. 


If the system does not behave well with this controller then Q 


and R must be changed. Suppose the state x^(t) is sluggish and needs 
to be speeded up. It may suffice to increase or to decrease the 
weighting on the control that predominantly controls x^. This scheme, 
however, may not work. Suppose the predominant mode of x^ is s^, in 
other words x. (t) c e where c is a constant. If s. is near a 

transmission zero then decreasing the control weight will cause s^ to 
move closer to the transmission zero, and this may even "slow down" s^. 

Now we give a method to determine how the modes change with respect 
to a change in one or more of the diagonal elements of Q or R. Simply 
use the following lemma which follows easily from the previous results 
of this chapter. 

Lemma 6 Let Q(p) and R(p) be dependent on p, and let 


Z 


A 

-Q(p) 


-1 T 

-BR(p) 


-A" 


Then for any p such that dZ/dp 
tinct s . , 

X 

\ 

arg(ds^) = arg(dp) + 


is well defined. 



and for any dis- 


(24) 


ds . 


dp 


H dZ 

w. — z. 

X dp X 
H 

w. z . 

X X 


(25) 


Suppose R is constant and 


Q = diag(qj_^, . . . ,pq^^, . . . ,q^^) 




5 . 



CHAPTER IV 


Equivalence Classes of Quadratic Weights 

4.1 Introduction 

As noted in Chapter II/ quadratic weighting matrices are not unique. 
Rather, many choices produce the same controller gains. This chapter 
provides a characterization of two classes of equivalent weights, and 
for one of them defines a unique canonical element. These characteri- 
zations may prove useful in design. 

0 00 

Both E and E equivalence classes are defined. Then sufficient 

conditions are given for different quadratic weights to be in the same 
00 

E equivalence class (in other words to have the same asymptotic pro- 

00 

parties) . A canonical element of the E class is defined, and an 

algorithm is given to find it. Finally, it is shown by example that 

the closed loop eiganstructure (and hence the optimal root locus) in 

00 

the nonasymptotic region can be different for members of the same E 
equivalence class. 

. . 0 °° 

4 . 2 Definitions of the E and E Equivalence Classes 

(Q,R) and (Q,R) are members of an equivalence class if they 
produce the same optimal gain matrix. We use the following notation: 

(Q,R) E° (Q,R) , 

where E° has the meaning "produces the same optimal gain matrix as." 

This is not the only type of equivalence class that can be defined. 
(Q,pR) and (Q,pR) are members of an equivalence class if they produce 

Q Q CO CO 

the same asymptotic properties (which are S , X , S , N , and y) • We 
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use the following notation: 

(Q,pR) e" (Q,pR) , 

00 

vdiere E has the meaning "produces the same asymptotic properties as.” 
The p is included in the parenthesis to emphasize the dependence on the 
control weight. 

4.3 Sufficient Conditions to be in the e” Equivalence Class 


In the form of two lemmas we present sufficient conditions for 
(Q,pR) and (Q,pR) to be in the same e” equivalence class. 

Lemma 1 Assume (A,B) is controllable cind P is optimal for some 

(Q,R) . Then 

(Q,pR) e“ (Q,pR) 

if there exists an n x n real symmetric y such that 

(i) Q = Q - A^y - yA 
(ii) ys = 0. 

To prove this we first show that for any p > 0 the closed loop 
eigenvalues of the optimal regulator aj:e the same when either Q or Q 
is used (the R is the same in both cases) . The closed loop eigen- 
values are the eigenvalues of Z, the Hamiltonian matrix, and the 
eigenvalues are invariant under the following similarity transformation: 


azu”^ = 


I 0 
Y I 


A 

-Q 


-Q+A Y+yA 


1 „„-l„T 
— BR B 
P 

-A^ 


I 0 
-Y I 


1 ^o^laT 

— BR B 
P 

-A^ 


Using the same transformation the eigenvectors o_' Z change from 
(p ip m T T X 

z. - (x. , x. P) to z. = (x. , X. (P+Y) ) . The x. portions are the 


closed loop eigenvectors of the optimal regulator and these do not change 
Since for any p > 0 the closed loop eigenstructure is invariant, the 
asymptotic properties as p -»• 0 are invariant. This completes the proof. 


To show that the closed loop eigenstructure is the same for any 
p > 0 we could alternatively have used a result due to Molinari [27] 
that was reviewed in section 2.3.8. We note that it is not necessarily 
true that Q ^ 0 or p+Y ^ 0. The conditions given here are only suffi- 
cient. We were not able to prove (and not able to find a counterexample) 
for the converse. 

For the next lemma let D and E be diagonal matrices with positive 
diagonal elements d^ and such that 

00 

DE = S . 

All of the other terms are defined in sections 2.3.10 and 2.3.11. 

Lemma 2 Assume that (A,B) is controllable? that F is optimal for 

Q Q GO 00 

some (Q/R) ? that the asymptotic properties are S , X , S , N , 

cind y; and that 


V. V. =1 for i = l,...,m 
11 


Then 


(Q,pR) e” (Q,pR) 


if there exists a D and Y such that 


H = [0, D] [X°, 


(1) 

~ OO -T -2 

00 —X 

(2) 

R = (N ) E 

(N ) 

- rp T 

Q = H H - A Y = 

- YA 

(3) 


Before proving this we note that equations (1-3) are similar to 

those used by Stein [5] in his algorithm for selecting quadratic weights , 

00 

as reviewed in section 2.3.11. He sets D=I, E=S , and Y=0? and he 



places no restriction on the magnitudes of the 's. 

The proof of lemma 2‘ is in two parts. The first part is to show . 

T 

that subtractxng A Y + YA in (3) does not change the asymptotic proper- 
ties, but this was established in lemma 1. The second pcurt is to show 
that S°° can be split into D and E without changing the asymptotic 
properties. The proof that Stein uses to prove his algorithm is only 

QB 

trivially changed when S is split into D and E, so we will not repeat 
it here. This completes the proof. 

Only sufficient conditions cure given in lemma 2 for quadratic 

oa 

weighting matrices to be in the same E equivalence class. We do not 

yet Icnow if these conditions are necessary, in other words if by chang- 

00 

ing D and Y every member of the E equivalence class can be reached. 

00 

The assumptions about the magnitudes of the 's cu;e made without 
loss of generality. These vectors are used to specify directions, and 
their magnitudes do not change the asymptotic properties. If the v^"'s 
are not of unit magnitude then it is always possible to find a diagonal 
matrix G such that the columns of N = N*G are of unit magnitude. 

00 -^ o 

Then in Cl) and (2) we can replace N by N , E by EG , and D by DG 
without changing H and R. 

Several other changes can be made in (l-’3) without affecting R and 

Q. The H in CD can be premultiplied, by an m x m unitary matrix (W 
T 

such that WW = I) . Then in C3) when Q is formed the influence of W 

is lost. In CD the magnitudes auid the order of the coliimns of X° and 

Y 

ail but the last m columns of U p can be changed without changing H. 

Y 

In (1) the order of the last m columns of Up, and in (2) the order of 

40 — 

the ' s can be chainged without changing either H or R, as long as the 
corresponding and e^'s are changed. 


4.4 A Canonical Element of the b” Equivalence Class 

00 

We define the canonical element of the E equivalence class to be 

~ ~ 00 
the (Q,pR) reached by (1-3) when D=I, E=S , and Y=0. By "canonical” 

we mean unique, but by changing D and Y many other canonical elements 
could be defined. The choice used here has an uncomplicated struc- 
ture and agrees with Stein's algorithm 1 5] when the v^°°'s are unit 
magnitude. 

Given any (Q,pR) it is always possible to find the canonical 
element. Use a generalized eigenvalue problem to find S° and X°, as 
described in section 2.3.10. Use the algorithm in section 5.2 to find 

CO OO CO 

S , N , and y* Then use (1-3) with D=I, E=S , and Y=0 (and with 

“T “ 1 » ~ ~ 

= 1) to find the canonical element (Q,pR) . 

4.5 Behavior of the Optimal Root Locus in the Nonasymptotic Region 

00 , 

Members of the E equivalence class have the same asymptotic pro- 
perties. They may or may not, however, have the same closed loop eigen- 
structure for p > 0. As a consequence the optimal root loci may look 
very different in the nonasymptotic region. This is important because 
when selecting a Q and R using (1-3) the final choice of pR uses a p>0. 

Suppose a (Q,pR) is computed using equations (1-3). If D and E 
are kept the same and Y is changed to get a different Q then the closed 
loop eigenstructure will be the same for any p>0. This we know is true 
by the proof of lemma 1 (arid also due to Molinari [27] ) . For any 

scalar a > 0 if D is changed to aD and E to (l/a)E then (Q,pR) will 
2 2 

change to (a Q,pa R) , and it is easy to see that the closed loop eigen- 
structure is the same for any p > 0. However, if D and E are changed 
in a more complicated way (change d^ to a^d^ and e^ to (l/a^)e^, where 


30 


the are all positive and not all equal) then the closed loop eigen*- 

structiire will not be the same for emy p > 0. Example 4.1 shows how 
the optimal root locus can change in the nonasymptotic region. 


Example 4.1 

We consider a linear system with the following A and B matrices. 



0 10 0 


0 0 


-5. -4 0.1 1 


0 0 

A. * 


B =» 



0.1 0 -1 0 


1 0 


0 0 0 -5 


.0 1 

J 


The asymptotic properties of an optimal linear quadratic regulator are 
specified, and equations (1-3) are used to compute the quadratic weighting 
matrices. Six different values of D and E are chosen. The purpose of 
this example is to show that the choice of D and E does not change the 
asymptotic properties but dramatically changes the behavior of the op- 
timal root loci in the finite region. 

The linecur system has four states and two inputs. The first input 
drives a first order subsystem with a pole at -1.0. The second input 
drives a third order subsystem which can be broken down into a damped 
oscillator with poles at -2 ±i and a first order "actuator" with a pole 
at -5. The 0.1 terms in the A matrix couple the two subsystems. 

The asymptotically finite properties are specified by 


1,2 



= 0.5 ± 3.0i 


i 


The "d" means that the eigenvectors are desired and not necessarily 


obtainable. The ”v" means that the element is not specified. The 
result of projecting the complex eigenvectors onto the obtainable sub- 
spaces is 


* 


■ - 

.341 


-.244 

.561 

+ 

1.146 

0 


0 

.232 


4.476 

• « 


• 


The asymptotically infinite properties are specified by 



I, Y= (01/ 02). 


In each of the six cases there are two first order Butterworth patterns 

The D, E, R, and H matrices are shown in Table 3.1. The optimal 
root loci are in Figure 3.1. We see that the behavior of the loci in 
the finite region is dependent on the choice of D cind E. The angles 
of departtire and approach are different in each of the six cases and 
are listed in Table 3.2. Points on the loci for different values of p 
are listed in Table 3.3. 

In the first case the 2,2 element of R is bigger than the 1,1 
element by a factor of 3200, and for p "not too small" this causes the 
subsystems to decouple. Since the second input is heavily weighted 
the pole at -1 does not move much. On the other hand the branches of 
the locus associated with the third order subsystem (driven by the 
first input) start to behave like the optimal root locus of a single 
input system. Two of the branches form a second order Butterworth 


pattern and the third branch approaches a transmission zero somewhere 


to the left of -5. Finally, as p gets "very small" the subsystems 
couple together and the specified asymptotic properties are achieved, 
'fhe branches that staurt at -2 ± i eventually meet on the real axis auid 
form two first order Butterworth patterns. 

In the second case the decoupling of the two subsystems is less 
apparent. The branches of the locus that start at -2 ± i meet on the 
negative real axis at about -4.S. One of the branches goes to the left 
and forms a first order pattern. The other goes to .the right, joins 
the branch that starts at -1, and then they approach the transmission 
zeroes. 

In cases 3 through 6 the branches that leave the open loop poles 
at -2 ± i eventually make it to the transmission zeroes at -.5 ± 3i. 
Given just the locations of the open loop poles and the transmission, 
the locus in case 4 is probably the most "desirable" pattern. This 
case allows a meaningful tradeoff between control weight and asymptotic 
properties. It happens to correspond to the canonical member of the 
E* equivalence class, as defined in the previous section. For a wide 
range of values of D and E the locus does in fact look like the' one 
in case 4. Not until the 2,2 element of R is smaller than the 1,1 
element by a factor of one million does the behavior of the locus in 
the finite region change significantly. The behavior in cases 5 and 6 
cannot easily be explained. The subsystems do not appear to decouple 
as in cases 1 and 2. 

From the above example it is not obvious how to choose the D and 
E matrices. Since only the ratios of the diagonal elements of the D 
and E matrices are important there are m-1 degrees of freedom available 
to the designer. (In the single input case there are no extra degrees 
of freedom) . It may be true that the extra degrees of freedom can be 
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used up by specifying cuigles of approach and departure, but we do not 
know of any algorithms that allow you to do this, nor do we know of a 
check to determine which eingles are valid. 
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Figure 4.1 

Optiinal Hoot Loci 

86945AW005 
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Table 4.3 

Poin-ta on the Optimal Root Loci of Example 4.1 


1 

10 

- 2.20 ± 1.531 


- 5.08 

- 1..28 


1 

- 3.03 ± 2.661 


- 5.55 

- 1.42 


.1 

- 5.16 ± 3.321 


- 6.93 

- 1.67 


.01 

- 18.5 

- 13.8 

- 2.17 1 2.011 



10 “ 16 

- 2x108 

- 10 ® 

- 0.50 1 3.001 


2 

10 

- 2.13 ± 1.411 


- 5.09 

- 1.24 


1 

- 2.77 ± 2.421 


- 5.60 

- 1.42 


.1 

- 4.30 ± 2.941 


- 7.68 

- 1.79 


.01 

- 19.7 

- 12.2 

- 1.90 1 2.281 



10 “ 16 

- 2x108 

-108 

- 0.50 1 3.001 


3 

10 

- 2 . 0911.341 


- 5,09 

- 1.21 


1 

- 2 . 61 ± 2.281 


- 5.63 

- 1.42 


.1 

- 3.84 ± 2.761 


- 8.01 

- 1.91 


.01 

- 1.73 ± 2.421 


- 20.1 

- 11.6 


10-16 

- 0.50 + 3 . 001 .' 


- 2x10 8 

- 10 ® 

4 

10 

- 2.00 ± 1.071 


- 5.09 

- 1.04 

•* 

1 

- 1.82 1 1.471 


- 5.72 

- 1.41 


.1 

- 1.33 i 2.331 


- 8.85 

- 3.32 


.01 

- 0.74 1 2.881 


- 21.1 

- 1.01 


10-16 

- 0.501 3.001 


- 2 x 10 ® 

- 10 ® 

5 

10 

- 1.73 1 1.181 


- 5.08 

- 1.87 


1 

- 1.65 1 2.061 


- 5.69 

- 2.77 


.1 

- 1.66 1 2.891 


- 8.84 

- 3.88 


.01 

- 1.04 1 2.991 


- 21.1 

- 10.1 


10 " 16 

- 0.50 1 3.001 


- 2x108 

- 10 ® 

6 

10 

- 1.89 1 3.111 


- 4.811 0.891 



1 

- 2.36 1 4.521 


- 5.99 1 2.891 



.1 

- 3.05 1 5 . 9 li 


- 8.31 1 1.581 



.01 

- 3.72 1 5.501 


- 21.1 

- 10.9 


10-16 

- 0.50 1 3.001 


- 2 x 10 ® 

- 10 ® 
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CHAPTER V 
Related Results 


The three sections in this chapter contain new results concerning 
the relationships between linear state feedback, quadratic weights, 
and the closed loop.eigenstructure. 

5.1 An Algorithm for Selecting F to Produce Desired Asymptotic Properties 

Xn this section an algorithm is given to implement the lALSF map. 
Given the asymptotic properties of the linear state feedback problem 
characterized by S°, X°, s”, and N**; we find a feedback gain matrix 
(1A)F tl.'.t produces these properties as k ^ 0. Only the generic case 
is considered, when Rank(CB) = m; and (A,B) is assumed to be controllable. 

The algorithm presented here is analogous to Harvey and Stein's 
algorithm [4] for selecting quadratic weights (the lALQR map) . The 
lALQR map gives a way to trade off eigenvalue and eigenvector placement 
with control energy, and indirectly this affects the feedback gains. 

The lALSF map gives a way to directly trade off eigenvalue and eigen- 
vector placement with feedback gains,, and indirectly this affects con- 
trol energy. 

S°, X°, s'”, and n"” are assumed to satisfy the following conditions: 
The S° matrix has (n-m) distinct diagonal elements. The columns of X°, 
as is always the case for closed loop eigenvectors , must be linearly 
independent and for each there must a such that (A - s^°I)x^°+Bv^°=0. 
Furthermore, it is assumed that the x^° are not in the image of B. 

CTo stay in real arithmetic, let S° be block diagonal and replace com- 
plex conjugates x.° and x. with Re(x.'‘) and Im(x.°)). The S matrix 

X X*i XXX 


0 


QB 

IS assumed to have m nonzero diagonal elements and N is assumed to be 


invertible. 

Theorem 1 The unique F matrix which produces the specified 
asymptotic properties is 

p - n“s"(n")“^[o,i] (1) 

To prove this we first show that P has the desired asymptotically 
finite eigenstructure. It suffices to show that tlie and satisfy 
the generalized eigenvalue problem 



This is true because by assumption there exists a such that 
(A “ s^°I)x^° + = 0, and by the way P is constructed Fx^° = 0. 

Since PB is full rank there are n-n solutions to this generalized eigen- 
value problem - namely the n-m specified values of and 

■ Nesst we must show- that P has the desired asymptotically infinite 
eigenstotcture. It suffices to show that the s? and satisfy the 
eigenvalue problem 


(si - PB)v.“ = 0 

09 

-s. 

where s = . 

k 


The parameter s is tne ith infinite mode as a function of s? amd k. 

r 

00 00 , 

The s^ and satisfy the eigenvalue problem because by the way that 
F is constructed 


PB 


N S 


i 00 —1 

(N ) 


The last thing to show is that F is unique. We know that PB is 
uniquely defined by s" and N°°. (If some of the s^°°'s are equal then 


the ' s are cirbitrary within a s\abspace but FB remains unchanged) . 

From the way that F is constructed we see that no extra freedom exists 

to choose F. (If F is multiplied by a scalar a then each s^* changes 
00 

to as^ , and the asymptotic properties are not the same.) The proof 
is complete. 

Example 5.1 The same A and B matrices are used as in example 4.1, 
namely that 


0 10 1 


o 

1 

-5 -4 0.1 1 


0 

0 

0.1 0-1 1 

B - 

1 

0 

0 0 0 -5 


0 

1 

— 


L J 


The asymptotic properties of this system are specified for three cases, 
and for each the F matrix is computed using (1) . The root loci are 
shown in Figure 5.1. 

The asymptotically finite behavior for each case is specified by 


^1,2 = -3 i 2i 


X 


1,2 


■ 0 


1 

• 

to 

CD 

0.571 

+ 

.859 

0 


0 

_-1.14 


.571 


The infinite behavior is different for each case. The specifications 
and the resulting F matrices are shown in Table 5.1. 

00 CO 


In the first case we have that = 1 and s^ =2. There are two 


infinite modes that stay on the negative real axis. In the second case 


S., = 1 ± i. * Since arg(-a., J°) = ± 120°, the two infinite modes 

4m f ^ 4. f ^ 


approach infinity along asymptotes that make angles of ± 120° with the 


positive real axis. In the third case s^ _ = -/s" ± i, and therefore 

L r ^ 


00 


1 J 


Figure 5.1 


Root Loci of a Linear System with State Feedback 

86945AW007 
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Table 5.1 

Matrices Used in Example 5.1 


Case 


00 00 00 
N S (N ) 
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the two infinite modes approach infinity along asymptotes that make 
0 

angles of ± 30 with the positive reed. axis. For high enough gain this 
closed loop system goes unstable. The auigles of depajrture and approach 
eure different for each case and are listed in Tcible 5.2. 

5.2 An Algorithm for Finding the Asymptotically Infinite Behavior of 
the Optimal Root Locus 

Given the A, B, Q, auid R matrices the objective is to find S*, N*, 
and Y/ which are used to cheuracterize the asymptotically infinite be- 
havior of the optimal root locus. We assvane that (A,B) is controllable 
and (M,A) is observable (where Q = m'^M, Rank(Q) = Rank(M) = p, and M 
is p X n) . 

The algorithm described here is a variation of Shaked's [9 ] , which 

can be used to find S* and y. The changes made to N* simplify the 

algorithm, the main reason for that being the use of srabspaces of R® 

spanned by the vectors v^“. After, some definitions the cd.gorithm is 

presented in the form of a theorem. The theorem is proved, the 

matrices cure discussed, and then eui example is given. 

Define the matrices 
T 

= B QB 

G 2 = (AB)'^QAB 

G^ * (A^"^B)'^QA^“^B, 

and 

T 

G. = J. J. 

1 1 i 

J. = ma'^“^b. 
r 

Define the subspaces of r” 


U. = U^n ker J. 

1 O 1 


u, -Uinker 


^ ^ . n ker J. , 
1 1-1 1 


with the dimensions such that 


dim U . , - dim U . ~ p. , 
1-1 1 ^1 


Z p. = m. 
^1 


Finally, define the matrices 


= matrix whose coltimns form a basis for U 


without loss of generality let = I. 


N. = m X p, matrix whose columns are the v. 's 
1 -^1 1 


correspoikding to the p^ ith order Butterworth 


patterns. If p^ = 0 then is missing and 


there are no ith order Butterworth patterns. 


X p^ diagonal matrix whose elements are the 


s j ' s corresponding to the p^ ith order Butter- 


worth patterns. If p^ = 0 then is missing. 


Using the above definitions we see that 


UU _ uu 0O_ 

N = [N^ ] 




wherfj k<n-m + lis the highest order Butterworth 


pattern . 



0 . 


In the generic case k 1 cuid ^ 


Theorem 2 For i = l,...,k consider the Jordan canonical forms 
‘°t-l “i-l - '«!’ t*!' "21"'' • 


A is a diagonal matrix with real eigenvalues > 0, and 



U. w 
i-l"l 



Remark If there are no ith order Butterworth patterns then ^ and 
A will be missing. 

The proof is by induction and uses the fact that all and 
(including those describing the asymptotically infinite behavior) must 
satisfy 

[pR + «'^(-s)<Ks)]v = 0 (3) 

where $(s) * M(sl - A)”^B 

= M(- I + ~ A + ...)B. 


Equation (3) is derived by Harvey auid Stein [4] . It can also be found 
by plugging A, B, C, and K of the Hamiltoniaui system (defined in section 


2.2.4) into (3.4) and manipulating the result. An expanded version of 


$ (-s)$(s) is shown below. 


$^(-s)$(s) = - -i- G, 
1 1 
s-^ 


— (-J^ J^ 4. J^ J^ 


+ 1 T 

T ^3 ^ ^2 


T 

" ^3 


+ - (-Ji + ^2 J3 - J3 Ja + J4 > 

3^ 

ITT T T 

4 (.j^ * ^2 ■^4 - S ^ ■^4 ^2 4 ■"S ■^1> 

s° 


' 1 j T 

+ 4- E. (-l)^J. J. . 

1=1 :> 


The first step is to show liiat the theorem is valid for i = 1. 
Assume without loss of generality that first order patterns exist. 
Rewrite C3) as 


[' 


1 T 
pR + ~~ B QB + 0 

s^ 




V = 0. 


As p ^ 0 the — term dominates and this bss'Offios 


I^Xi - r“^ b'^qbJv = 0 

where A =■ ps^. 


-1 T 

The eigenvalues of R B QB are real and ^ 0. (This ?s because the 

-i. >2 -Jj 

eigenvalues are the same as those of R B QBR ^ «s*is;h Is a matrix of 
T 

the form X X, which is known to have real eigenvalues > 0) . From the 

“1 T 00 

Jordan canonical form (2) of R B QB we see immediately that ~ ^ 1 * 

2 

For each nonzero eigenvalue we have that s = -A/p , and the solutions of s 
are ±A /p . As p ->■ 0 the branch of s in the LHP is a first order Butter- 

00 J« CO 

worth pattern with = A . The not associated with first order 

T CO 

patterns lie in the kernel of R B QB, which is equal to L^. These 's 

-1 T 

are not "trapped" by R B QB. 


The next step in the induction is to assume that N. , and S. . 

^ 1-1 1-1 


kUtVtaW.. 
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are valid, and.. then show that N.” and S.* are valid. The 
corresponding to ith order patterns must lie in 

OB 

N . “ D . W- for some W, . The case where there are no ith order patterns 

is trivial, because the is missing. Therefore assume that there 
exists at least one ith order pattern. The next step is crucial. Fac- 

QB 

tor out of (3) the influence of the 's corresponding to lower order 
patterns. Do so by multiplying (3) on the left and right as shown be- 
low: 


+«'^(-s)$(s)]D^_^aj » 0. 


After some work this reduces to 


fpD. *^RU. , + (-1)^”^ U.'^ G.U. , 

I i-1 x-1 g2x x-1 X x-1 Vg^V 


l(u = 0 . 


^ p ^ 0 the first term dominates and this can be written 


[XI - (U. RU. HU. ‘^G.U. ,)]6l =» 0 

XX i. X 1 1-1 

where X = (-l)^ps^^. 

The eigenvalues are real and 0. Prom the Jordan canonical form (2) 

we see that = ^i-1^1* solutions of s in the left half plcuie 

OD L 00 

form an ith order Butterworth pattern with = X . The not 
corresponding to 1 through ith order patterns must lie in This 

completes the proof. 

The subspaces are shown in Pigtire 5.2. The following properties 
of the are simple consequences of the definitions and the above 
theorem. 


(i) 0 = U|^c e... cU^ . R 


m 



(iii) if there are no ith order patterns. 

Use the following algorithm to find the matrices. In simple 
examples this can be done by hand. In more difficult examples use the 
software described below. 

1) Find a basis for » ker call it U^. 

«r 2) If dim » 0 then let k=l cuid stop. 

3) Let i»2. 

4) Find a basis for ker 

5) Find a basis for U. =U, /I ker J. , call It U. . 

6) If dim a 0 then let k=i and stop. 

7) Go to 4. 

Singular v 2 Llue decomposition (SVD) can be used to find am orthonormal basis 
for the ker J^. Since ker = ker and G^ is symmetric, another way 
to find a basis for ker is to use the eigenvectors associated with 
the zero eigenvalues of G^. SVD cam also be used to find am orthonormal 
basis for the intersection of two subspaces, see section 3 of 
Laub's report [41] for more details. An orthonormad. basis is not necessary 
for our piirposes. FORTRAN subroutines exist in EISPACK [10] to compute 
the SVD aind the eigenvalue decomposition. 

The problem of finding Butterworth patterns of order greater than 
one is numerically an ill-posed problem because an arbitrarily small 
chamge in A, B, or Q cam cause a change in the order of the Butterworth 
patterns. By using proven software we have tried to minimize the 
numerical problems, but we cannot get rid of them- 


Example 2 Use the same A and B matrices as in example 1. Given 


Q Q 00 00 

H and R the problem is to find S , X , S , N , and y for the optimal 


root locus. Let 


-65 0 


100 10 


0 1*] r .01 -.01 1 

0 oj L-.oi .121lJ 


Using a computer program that finds the transmission zeroes of S(A,B,H) 
by using a generalized eigenvalue problem we see that 

r -.0891 


s. = -10 
1 


-5.79 


We now implement the algorithm described in this section for finding 
s”, k”, and y. 


i’’ = ™ ■[ 1 =[ 

Lo oJ LoJ 


|_4. XUJ 


The ntamber of 1 order patterns is dim “ dim ~ 
nd 

The number of 2^ order patterns is dim ^ ^ 2 ~ 

The Jordan canonical forms are 

ro 9l ["l llf9 0 "| [*0 l' 

R- G = = 

_0 9j Ll OJLo OJ Ll -ij 


(U^'^RU^)-^ U^'^G^U^ = 100 


Therefore 


5.3 Approxima-tinq the Optimal Root Locus 


In this section we are concerned with optimal root loci that have 
Butterworth patt^pms of order greater than one. What we will show is 
that any optimal root loci can be ^iproximated by another that has only 
first order Butterworth patterns, and this approximation can be made 
arbitraurily precise for aui arbitrary distance out along the asymptotes. 
This result is significcuxt because it allows any optimal root locus 
problem to be treated as a generic problem, and the generic problem is 
niamerically better conditioned than the nongeneric problem. 

The basic idea will first be presented in words. Then a more for- 
mal proof will be given using two lemmas and a theorem. Finally, an 
example will be given. 

Start with the well known fact that if Rank(HB) = m then the optimal 
root locus will have m first order Butterworth patterns. (If Q cannot 
be factored into then use M instead of H) . In the first lemma it 
is proved that if Rank(HB) < m then H can always be perturbed an arbi- 
trarily small amount such that the new H times B is full rank. In the 
second lermia an old result is quoted that essentially says that the 
eigenvalues of a matrix are continuous with respect to the elements of 
the matrix. Then in the theorem the Hamiltonian system matrix, for ■ 
some fixed value of p , is perturbed a small amount so that the eigen- 
values move less than a prespecified amount and the rank condition on 
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HB is changed. For p smaller than this the infinite modes of the 

optimal root locus will fall into first order patterns. 

Lemma 1 Let H be a real m x n rzz.cxix and B a real n x m matrix. 
If B is full rank then there <axists a AH such that for all a ^ 0 
Rank(H+AH)B = m. 

Proof Let AH = where Im(W) = Im(B) - Im(H'^) A Im(B) . 

The next lemma is copied from Wilkinson [38] and is due to 

Ostrowski. The bound given is not computationally useful due to the 
1/n 

a term. 

Lemma 2 Let A and B be n x n matrices with elements that satisfy 
the relationships 


Then if X’ 

A such tliat 


a. . <1 

' 13' 


lb,. I < 1 


is an eigenvalue of A + oB, 


there is an eigenvalue X of 


|x'-X| < (n+2) (n^a)^^“. 

Now we consider two optimal root loci. Let X be an eigenvalue on 
the root locus generated by A, B, H, and R. For some p = specify 
a ball of radius s centered around each X. Let X' be an eigenvalue 
generated by A, B, H + aAH, and R. We have the following result. 

Theorem 3 For every p >0 and e > 0 there exists an a > 0 and 

AH such that 


(i) Rank(H + aAH)B = m 

and for every p in the interval p^ < p < ® 

(ii) [x‘ - x| < e. 

The proof for the case Rank(HB) = m is trivial because we can 
let AH = 0. When Rank(HB) < m choose a AH such that Rank(H + aAH)B = m 
for all a > 0, which is always possible from lemma 1. Next, use the 
fact that the optimal root loci corresponds to the LHP eigenvalues of 


A 

- - br'^b'^'I 

T 

_-H H 

1 

<< 

1 


Z 


Let p « p^. When H is changed to H -4* aAH then Z chcinges to 

0 0 

Z + oAZ » Z + a 

H^HAH + AH^H + oAH^AH 0 

T 

The aAH AH term can be dropped because for a sufficiently small the 
\ largest element of oAh'^AH will be less than the largest of H^AH +AH% 

Choose 0 such that th<\ largest element of (1/0) Z is less than one 
in absolute magnitude. Without loss of generality assume also that 
the largest element of (1/ 0)AZ is less than one in absolute magnitude 
which will be true for a sufficiently small. Apply lemma 2 to get 

\X' - a 1 < 0(2n + 2) (4n^a) 

vdiere 2a is used instead of n because Z is 2n x 2n. The 0 term is 
included because if X is an eigenvalue of Z then X/0 is an eigenvalue 
of (1/0) Z. Now choose a such that 

|X' - X| < 0(2n + 2) (4n^a)^'^^“ < e. 

this can always be done, even though a may be very small. The theorem 
has been proved for p = p^. 

For p > p^ recompute Z and call it Z'. Let 0' be its largest 
element and note that 0' 0. Then using the same a in (4) we see 

that the distance between the eigenvalues of Z' auad Z' + aAZ is also 
less than e. This completes the proof. 

Example 3 Use the same A amd B matrices as in examples 1 and 2, 
and. let 




The optimal root locus has no finite modes. The four infinite modes 


. . * 
group into a first and third order Butterworth pattern with N =1, 

oa 

S =1, and Y = CQlf 02, 12, 22). Now suppose H is perturbed in such 
a way that RankCH + aAH)B s m. Let 



The optimal root locus is plotted for a = 0, .01, and .001. The results 
are in Table 5.1 and Figure 5.3. We see that when a > 0 the tJiird 
order pattern shifts into a first order pattern and two new trans- 
mission zeroes appear. For the case when a = .01 the two optimal root 
loci are within e = .1 until p is less than .001. For the case when 
a = .001 the approximation is within e = .13 until p is less than 10 
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CHAPTER VI 
Conclusion 

The linear state feedback probl^ was studied in this thesis , and 
ais a special case the linear quadratic regulator was studied. Of 
primary interest was the relationship between the state feedback gain 
matrix and the closed loop eigenstructure of the linear state feed- 
back problem, and the relationship between the quadratic weights emd 
the closed loop eigenstructure of the linear quadratic regulator. 

Several new results were derived which will help both the analysis and 
the design of multivariable linear control systems. 

The relationships were discussed in terms of maps between parameter 
spaces. The names of the maps used here au:e not standard and not 
important, but this seems to be a natural way to discuss the relation- 
ships. The similcurities between the lineeu: state feedback problem euid 
the linear quadratic regulator become clear vrhen using these maps, and 
these similarities were exploited in this thesis. 

In Chapter III equations were derived to compute cmgles on the 
root locus and the optimal root locus, including angles of departure 
and approach. For the first time the generalized eigenvalue problem 
was used to compute the angles of approach. Then the quadratic weights 
were defined to be continuously dependent on p and equations were given 
for the direction and rate of change of the closed loop eigenvalues 
with respect to p . These equations were used to analyze the inverse 
square method of selecting quadratic weights. All of the above results 
are valid only at the points where eigenvalues are distinct. Extending 
these results to multiple eigenvalue points appears to be a nontrivial 


problem. 


In Chapter IV two different kinds of equivalence classes of 
quadratic weighting matrices were defined. Most of the attention was 
given to the e" equivalence class - those quadratic weighting matrices 
that produce the same asymptotic eigenstructure . Sufficient conditions 
were given for matrices to be in the E equivalence class, a canonical 
element was defined, and an algorithm given to find the canonical ele- 
ment. Then it was shown by example that the closed loop eigenstructures 
can be different in the nonasymptotic region for members of the same 
e" equivalence class. 

0 

More research needs to be done concerning the E and E equivalence 
classes. Necessary conditions need to be derived for matrices to be in 
the same e” equivalence class, and these condit':>ons are probably not 
much more complicated than the sufficient conditions already derived. 

CO , 

It would also be beneficial to divide up the E equivalence class 

according to the equivalence relation that the closed loop eigenstruc- 

ture be the same in the nonasymptotic region. Having the same angles 

of departure and approach may be a way to do this, having the same D 

and E may be another. Similar questions apply to the S° equivalence 

class. We do not yet know if all members of the E° equivalence 

class (those quadratic weighting matrices that produce the same optimal 

gain matrin:) have the same asymptotic properties. If not then the E° 

equivalence class can be f\irther split up. Within this (possibly) 

smaller set of quadratic weighting matrices a canonical element can be 

defined that has the following properties (and possibly others in order to 

T 

assure uniqueness) : the Q is of rank m and S(A,B,H) (where Q = H H) 
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has transmission zeroes in the left half plane. To find this canonical 
el-aient the asymptotic properties of the original (Q/R) can be found, 
appropriate 0, E, and Y matrices can be chosen, and then using equations 
(4,l-4o3) the canonical (Q,R) can be computed. 

Three related results were derived in Chapter V. The first was 
a synthesis solution for the linear state feedback problem. An 
algorithm was given that finds a feedback gain matrix ^ P that produces 
specified asymptotic properties as k 0. Only the generic case was 
considered, so the obvious next thing to do is to extend this algorithm 
to handle nongeneric cases. Also, this technique may yield insight 
into selecting a feedback gain matrix K for the output feedback problem. 
In the generic case K can be chosen to arbitrarily select s" and N* , 
but K has no effect on S°, X°, or 

The next result was an algorithm to compute s", N°*, and y 
implicit in a set of quadratic weights. With this algorithm and previous 
results for and ,X° all of the implicit asymptotic regulator pro- 
perties can now be found. With obvious similarity to the output feed- 
back problem, the asymptotic properties S°, X°, and y can be fotind from 
A, B, and Q; and S* and N* can be found from A, B, Q, and R. The next 
thing to do is to modify this algorithm to find s”, n", and a multi- 
index similar to y Sox the output feedback problem. This will be 

more difficlut because the closed loop eigenvalues are no longer guaran- 

00 

teed to be. symmetric about the imaginary axis. The elements of S are 
found by solving various eigenvalue problems, and because symmetry is 
not guarainteed the eigenvalue problems may ha:ve Jordan blocks of size 


2 X 2 or greater. 
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The final result shows that an optimal root locus with Butterworth 
patterns of order greater than one can be approximated by an optimal root 
locus with all first order Butterworth patterns, and this approximation 
can be made arbitrarily precise for an arbitrary distance out along 
the asymptotes. This result may help to analyze optimal root loci. 
Determining the order of Butterworth patterns is numerically a badly 
conditioned problem, so by restricting our attention to a finite region 
of the complex s plane we can use the better conditioned problem of 
analyzing first order patterns. 
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APPENDIX A 


Transmission Zeroes 

Definition 

Several definitions of transmission zeroes exist in the literature 
and all have some validity. Common sense dictates that - the definition 
reduces to the usual one in the SISO case Cthe roots of the numerator 
polynomial of the transfer function) and that the transmission zeroes 
have some physical meaning. One definition that meets these require- 
ments is due to Rosenbrock [6] , which is the one used here. Though it 
is too early to know for sure, the control community appears to be 
settling down to this definition. 

Rosenbrock defines the system matrix 


PCs) 





Cl) 


and his definition of transmission zeroes is given in terms of the 
minors of PCs). An equivalent definition uses the Smith McMillan form 
of PCs) [42j . Since for our purposes we have the same number of inputs 
and outputs we use the following equivalent definition [7,43] : The 

transmission zeroes are those values of s, including multiplicities but 
not including uncontrollable or unobservable modes, that reduce the 
rank of PCs). We note that this definition allows the degenerate case 
where the whole complex plane reduces the rank of PCs); this can happen 
even if B and C are full rank and the system is controllable and obser- 
vable, we note also in the square case that the determinant of PCs) is 
equal to 

detCA-sI)det[CCA-sI)“^B] , C2) 



and smother eqoxvalent definition of transm 7 .ss 3 .on zeroes is the roots 
of (2) . This definition is used by KwsUceimaak and Sivsui [8] . 

To demonstrate that Rosenbrock's definition has physical meaning 
[42J we consider the linesu: output feedback system of section 2.2.2. 
Assume that it is controllsible smd obse3r7sd:le and then Laplace trsmsforn 


(2.4, 2.5) to get 


A - SI B X 


0 u 


Transmission through the system is blocked (the output will be zero) 
for certain values of s, x, and u. Those values of s for which this is 
t:rue au:e transmission zeroes, and the corresponding values of x cire cailled 
zero directions. 


The Generalized Eiaenvalue Problem 


The problem is to find all finite a and their associated eigenvectors 
V which satisfy 


Lv = AMv, (3) 

where L and M are real p x p matrices not necessarily full rank. There 
will, be from 0 to p finite solutions. If M is invertible then preaulti- 
plication by M ^ changes the generalized eigenvalue problem into an 
eigenvalue problem and tiiere will be exactly p solutions. Stable and 
reliable FORTRAN subroutines exist in EISPACK [10] to solve the generalized 
eigenvailue problem. 


Computing Transmission Zeroes 


Three different methods for computing « fc*Sion zeroes are dis- 




cussed. The relationship between the first two methods is am unpublished 
result due to Laub. Only the special case of am equal number of inputs 

emd outputs and no feedforward term is discussed. 

i 

Laub and Moore [40] discuss in detail using the generalized eigen- 

1 

value problem as a way to compuite tramsmission zeroes. In place of (3) 
use 


'a b"! r*! fi r*' 

= X 

:-C 0_ ,0 0_ _V_ 


The finite solutions X reduce the rank of Rosenbrock's system matrix (1) 
amd therefore aure transmission zeroes. There are anywhere from 0 to 
(n-m) transmission zeroes, and in the generic case when Rank(CB) = m 
there are exactly (n-m) solutions. The portion x of the associated eigen- 
vector is the zero direction. 

Davison and Wamg [44] use high gain feedback and an eigenvauLue 
problem to compute transmission zeroes. First they prove that as k -»• 0 
the fi.nite closed loop eigenvalues of 

A - = A - ^ BKC (5) 

cl k 

approach the transmission zeroes. Their method is to find a "suitably 
small" value of k, compute the eigenvalues of then determine 

which are finite. The eigenvectors associated with the finite eigen- 
values are the zero directions. 

These two methods are closely related. The connection is the result 
derived in section 3.2.1 that the closed loop eigenvalues and eigenvectors 
are solutions of the generalized eigenvalue problem 


Equations (5) and (6) give the same answers for Ic > 0 and in the limit eis 
k 0. The only difference is that in (6) k can be set exactly to zero. 
Equation (6), incidental ly^ is an obvious way of proving that as k 0 
the closed loop eigenvalues approach the transmission zeroes. 

A third approach is fo\wd in various papers by MacFarlane, Karcanias 

Kouvzuri takas , and Shaked [for instance 42,18] . They define N and M 

such that the rows of the (n-m) z n matrix N form a basis for the ker 
T 

(B ) 2 md the colimans of the nx(n-m} matrix M form a basis for the ker(C) . 
Then the transmission zeroes 2 u:e the roots of the polyncinial 

det(NAM - XMM) - 0. (7) 

This result can be derived using similarity trzmsformations on the 
matrices in (4) , see [42,18] for details. In the generic case when 
Rank(CB) * m then Rank(NM) * (n-*m) and (7) is an eigenvalue problem, ie 
the (n-m) eigenvalues of (KK)*’^NAM are the transmission zeroes. In the 
nongeneric case when Bank(CB) < m then it is not cleu how to continue, 
other than to treat (7) as a generalized eigenvalue problem. 

The first, method, by Laub Moore, has the best nianerical proper- 
ties and is the one to use. While all three methods give excellent 
results in some cases, Laub amd Moore give examples where the other two 
methods break down. In Davison and Wamg's method it is not obvious 
how to choose a suitably small k, auid in some cases the accuracy of the 
auiswer is critically dependent on this choice. Furthermore, Davison and 
Wang ' s method gives no indication when the answers au:e in error ; auid 
therefore their method is unreliable. The method by MacFarlauie et al. 




Errata 


page 14, paragraph 2, line 7; 

change "-s^" to "-Re(s^) + ilm(s^)" 

page 15, paragraph 1, line 4: 
change "trace" to "trick" 

page 23, paragraph 1, line 4: 
change to "Bv“" 


page 32, paragraph 2, line 16: 
change "call U" to "call U 




page 35, paragraph 3, line 2: 
change "u'^p" to "U^P" 

page 48, Theorem 2: 


-1 


W..H 


Change •.„ 


to 


-1 H 

w . 

H 1 

w. z . 

X 1 


pcige 49, paragraph 4, line 6: 


change to: LHP, let I be the mirror image about the imaginary 

axis of s^, and let 

-H pT H H 
z . = (x . , 5 ) 

1 X 


page 75, paragraph 1, line 11: 
change "V . ' s" to "v . ' s” 

1 i 

page 81, paragraph 1, line 9: 
change to "J^" 

page 81, paragraph 1, line 10; 

1/2 

change the 2 occurances of "G " to "J_" 

>St 


